DESCRIPTION 
METHOD AND SYSTEM FOR IMAGING AN OBJECT 

TECHNICAL FIELD 

[001] The invention relates to a method of creating an image of an object, particu- 

larly for dental purposes, comprising the following method steps: a) projecting 
a striped pattern on to the object to be imaged, b) recording the projected 
striped pattern as a basic image with a camera, the steps a) and b) being car- 
ried out at a number of different positions of the phase relationship of the 
striped pattern, and c) computing an image of the object to be imaged from the 
plurality of mutually out-of-phase basic camera images. Suitable images are, 
in particular, relief images or contrast images. 

BACKGROUND OF THE INVENTION 

[002] Direct optical three-dimensional surveying of one or more teeth in the mouth of 

a patient can provide digital construction data for the computer-controlled pro- 
duction of dentures without using a dental impression. Such a three- 
dimensional representation, known as an "optical impression" in analogy to 
physical molding, can be made with one or more camera images without con- 
tacting the object. The camera can be freely guided for this operation like an 
angled handpiece or guided with one or both hands whilst supported on the 
teeth. 

[003] The method of measurement implements the principle of active triangulation, 

in which a single stripe of light or a striped pattern of parallel stripes of light is 
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projected on to the object to be imaged by projecting means and the projected 
image is recorded by a y two-dimensional camera at an angle of parallax. 

[004] By reason of the surface texture of the teeth the projected stripe is no longer a 

straight line but appears to be curved and displaced relatively to the straight 
path. The position of the lines of light can provide information on the surface 
texture of the object being imaged. Following the measuring procedure, the 
memory of the computer contains a digital three-dimensional data model of the 
imaged object, which can be displayed, for example, on a monitor as a still 
video picture or can serve as the basis for the computer-controlled production 
of a denture. 

In order to increase accuracy, use may be made of the phase-shifting triangu- 
lation method. This method involves the successive production of a number of 
basic images at various positions of the phase relationship of the grid, and 
from these images a phase related image is computed. From the phase re- 
lated image it is then possible, with the aid of calibration data, to compute a re- 
lief image of the object. Various algorithms for the computation of the phase 
related image from the individual basic images are known. For example, three, 
four, or five basic images showing a relative phase shift of 120 ° or 90 ° can be 
recorded. It is also possible to compute a contrast image from the basic im- 
ages. For example, a contrast image can be computed from four basic images 
having intensities I^... I4 according to the formula: 

K = V ( (l 1 - i 3 ) 2 + (i 2 - i 4 ) 2 ) . 
[006] The phase-shifting method involves, on account of tolerances or systematic 

sources of error, typical periodic disturbances or noise. These periodic distur- 



[005] 
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bances occur in the phase related image and also in the contrast image or re- 
lief image at a multiple of the grid frequency. 

For example, any deviation from the linear motion of the optical grid leads to 
noise at 2-fold grid frequency, any change in the intensity of the grid illumina- 
tion to noise at 1-fold grid frequency, and deviations from the linearity between 
the light signal and electrical signal leads to noise at 4-fold grid frequency. 

In general, the computing algorithms become less prone to noise generation 
as the number of recorded basic images increases. Nevertheless, the 
described periodic disturbances are expressed to various degrees despite the 
distinctly more elaborate treatment. 

The quality of the phase related image and contrast image may be increased, 
for example, by effecting filtration. This must mean a loss of resolution how- 
ever. Improvement in quality caused by averaging a plurality of phase related 
images or contrast images suffers on the other hand from the drawback of a 
distinctly prolonged recording time. 

It is further possible to effect control over the recording of the basic images in 
a very precise manner such that the periodic disturbances occur to a lesser 
extent. However, such precise control involves elaborate means. In addition, 
external conditions, such as temperature, moisture, or the force of gravity, and 
also long-term effects have an influence on the imaging process and the im- 
age quality obtained. 

These problems are solved by the present invention. It is an object of the in- 
vention, as characterized in the claims, to provide a method of the above type 
for creating an image of a an object, which method affords much greater 
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measuring accuracy than known techniques whilst involving comparatively lit- 
tle elaboration. 

SUMMARY OF THE INVENTION 

[0012] This object is achieved, according to the invention, by the method defined in 

claim 1 and the imaging device defined in claim 11. Advantageous embodi- 
ments of the invention are the subject matter of the sub-claims. 

[001 3] The invention improves on the prior art in that suppression of periodic distur- 

bances in the method step c) involving the computation of an image of the ob- 
ject from the plurality of basic camera images that are out-of-phase relatively 
to each other is effected by: 

[0014] c-| ) forming at least two groups of basic images from the basic camera 

images, 

[001 5] C2) computing a phase related image of the object to be imaged from 

each group of basic images, 

[0016] C3) averaging the computed phase related images using weighting factors, 

in order to obtain a phase related image having a reduced amount of noise, 
and 

[001 7] C4) computing an image of the object from the phase related image having 

a reduced amount of noise. 

[0018] The use of the method c<]) to C4) makes it possible to suppress noise in a re- 

lief image or in a contrast image. Thus the invention is based on the principle 
of dividing the basic images into two or more groups such that the noise in the 
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phase related images computed from the respective groups of basic images 
show a certain degree of phase shift relatively to each other. These phase re- 
lated images are suitably averaged so as to suppress or eliminate noise of 
specific multiples of the grid frequency. By this means additional basic imaging 
can increase the measuring accuracy to a marked degree with only slight pro- 
longation of the total imaging time. 

[0019] Preferably each of the basic images is recorded in the method of the invention 

with a constant shift of the phase relationship in the grid. 

[0020] In a preferred embodiment of the process of the invention, provision is made 
for recording of (n+1) basic images R>|, R2 R n+1* of which successive ba- 
sic images exhibit a predetermined phase shift. Two groups of basic images 
R-|,R2, R n ; R2» R 3> R n+1 are formed, and a first phase related image 
P-l is computed from the first group of basic images R-| , R2, R n and a sec- 
ond phase related image P2 is computed from the second group of basic im- 
ages R2, R3, Rpi+1- The first and second phase related images, P-| and 
P2, are averaged with identical weighting, in order to obtain a phase related 
image P having a reduced amount of noise. In this case, n is an integer 
greater than or equal to 3, to make it possible to produce a phase related im- 
age by known methods. 

[0021] Another preferred embodiment of the process of the invention, makes provi- 

sion for recording of (n+2) basic images R-|, R 2 , .... R n +2' of which each suc- 
cessive basic image exhibits a predetermined phase shift. Three groups of ba- 
sic images R-| , R2, ...,R n ; R 2> R 3» ■••> R n+1 * R 3» R 4> R n+2 are formed, and 
a first phase related image P-| is computed from the first group of basic im- 
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ages R-j f R2, R n . a second phase related image P2 from the second group 
of basic images R2, R3, Rn+1> and a third phase related image P3 from the 
third group of basic images R3, R4, R n +2- The first and third phase related 
images P<] and P3 are averaged with identical weighting, in order to obtain an 
intermediate image P z , and the second phase related image P2 and the in- 
termediate image P are averaged, in order to obtain a phase related image P 
having a reduced amount of noise. Here n is an integer greater than or equal 
to 3. 

[0022] In the case of the two embodiments described above it is preferred that n be 

equal to 4, because in this case the measuring accuracy and the measure- 
ment time required bear a particularly favorable relationship to each other. 

[0023] According to a development of the method of invention, provision is made for 

recording the basic images by the interlacing method so that when the striped 
pattern is continuously moved, the two fields show a phase shift relatively to 
each other which is half the phase shift between successive basic images. In 
the interlacing method, the image to be produced is split up into two fields. The 
first field usually corresponds to the even-numbered lines and the second field 
to the odd-numbered lines. The two fields are recorded successively and con- 
sequently at different times. It is an advantage in this context when a phase re- 
lated image is computed from each of the fields of a basic image, and the two 
phase related images are averaged prior to further processing, in order to ob- 
tain a phase related image having a reduced amount of high-frequency noise. 
If, for example, the basic images are recorded with a phase shift of 90° with 
continuous motion of the grid producing the striped pattern, there results a 
phase shift between the two fields of 45 . Decisive in this case is the time cen- 
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ter of the integration phase during the production of the fields, the duration of 
the integration phase itself, i.e., the duration of exposure of the detector, being 
of minor importance. In this way, averaging the two phase related images or 
contrast images can suppress noise having 4 times the grid frequency. This 
must be coupled with a loss of resolution, but in the case of severe noise the 
positive effect of noise suppression predominates. Averaging is preferably car- 
ried out using a running mean. 

[0024] Advantageously, one method of the invention is characterized in that, prior to 

step a), an image of a specific test object is recorded, and, on the basis of an 
analysis of the image of the test object, a suitable scheme for use in computa- 
tion of the noise-reduced phase related image for the object to be imaged is 
selected. Since periodic disturbances governed by external influences can oc- 
cur either sporadically or may always be present due to the system used, this 
measure can ensure that an algorithm that prolongs the recording time can 
only be used when the relevant disturbance occurs during recording. 

[0025] Recording of the test object can take place without substantial loss of time 

during the calibration of the system, which is in any case necessary for com- 
putation of contrast or relief images from the phase related images. However, 
it may be also carried out separately, if desired, so that prior to each meas- 
urement of an object to be imaged the most favorable computation scheme 
can be selected. 

[0026] The method of the invention is of particular advantage for those systems in 

which the object to be imaged and the camera can be freely positioned rela- 
tively to each other for the purpose of recording the projected striped pattern, 
and free-hand recording can be carried out. 
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[0027] A particularly preferred application example comprises recording a relief image 

of one or more teeth in the oral cavity of a patient, which is executed over a 
short measuring period by manual surveying. And the resulting increase in 
measuring accuracy attained according to the invention without substantial 
prolongation of the recording time is of special advantage. 

[0028] A device of the invention for the execution of the aforementioned method 

comprises projecting means for projecting a striped pattern on to the object to 
be imaged, a camera for recording the projected striped pattern as a basic im- 
age, and means for computing an image of the object to be imaged from a 
number of basic camera images that are out-of-phase with each other and are 
grouped to form at least two groups of basic images. 

[0029] Other advantageous embodiments, features, and details of the invention are 

revealed in the subclaims, the description of the embodiments, and the draw- 
ings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0030] The invention is explained in greater detail below with reference to an em- 

bodiment in conjunction with the drawings. Only those elements essential for 
comprehension of the invention are illustrated. In the drawings: 

[0031] Fig. 1 is a diagrammatic representation of a recording device of the invention 

conforming to the principle of phase shift triangulation; 

[0032] Fig. 2 shows a graph representing the phase cp of six basic images R i? where i 

= 1..6 relatively to a reference phase; 
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[0033] Fig. 3 shows a graph representing the amplitude A of a disturbance of 2-fold 

grid frequency as a function of the phase cp; 

[0034] Fig. 4 shows a graph representing the amplitude A of a disturbance of 1-fold 

grid frequency as a function of the phase cp; and 

[0035] Fig. 5 is a diagrammatic drawing of an intraoral camera; and 

[0036] Fig. 6 is a diagrammatic representation of a portion of the projection ray trajec- 

tory of the intraoral camera of Fig. 5. 

WORKING EXAMPLES 

[0037] Fig. 1 is a diagrammatic representation of a recording device designated by 

the reference numeral 10 and adapted to operate according to the principle of 
phase shift triangulation. The projecting device 12 produces a grid of light hav- 
ing parallel grid lines projected on to an object to be imaged, in the present 
example a tooth 20. By reason of the three-dimensional surface texture of the 
tooth 20, the lines of light in the grid on the tooth appear to be bent and un- 
evenly spaced. The image 22 projected via the projection ray trajectory 13 is 
recorded (videographed) at an angle of parallax by means of a two- 
dimensional camera 14 disposed in the trajectory of observation 15 and is 
passed on to an evaluation unit 16 for evaluation. The projecting device 12 
and the camera 14 may be combined to form a structural unit 11, as will be 
later shown in Fig. 5 in the case of an intraoral camera. 

[0038] After the first basic image R % has been recorded, further basic images showing 

defined phase shifts are recorded, as illustrated in Fig. 2. This figure shows 
the phase cp, in relation to the reference phase 0°, of each of six basic images 
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Rj, where i = 1, 6. Any two successive basic images exhibit a phase shift 

Acp of 90°. The constant phase shift produces a straight line 30 in the phase 
related graph. 

Control of the projecting means 12 to produce the phase-shifted grid of light is 
likewise effected by the computer unit 16. 

In one embodiment of the invention an algorithm is used which is based on the 
use of four basic images showing a phase shift of 90° between successive ba- 
sic images. The computer unit 16 calculates, in known manner, the phase of a 
halftone dot from the intensities of the four basic images. In the present inven- 
tion, there are recorded not four, as in the standard algorithm, but five basic 
images R-|, ...,R5 which are successively out-of-phase with each other by 90°. 
This prolongs the recording time by 25%. 

A first phase related image P-| is then computed from the basic images R-j to 
R4 according to the standard algorithm and a second phase related image P2 
is computed from the basic images R2 to R5. Since the successive basic im- 
ages R-|, R2 to R4, R5 show a phase shift of 90° relatively to each other, the 
two phase related images and P2 are also out-of-phase with each other by 
90°. The two phase related images P>| and P2 are then averaged. Noise of 2- 
fold grid frequency is thus suppressed to a high degree or eliminated. 

This is illustrated in the graph of Fig. 3 showing the amplitude A of noise of 2- 
fold grid frequency as a function of the phase (p. The line 32 (light squares) 
shows the curve of the noise in the phase related image P-|, and the line 34 
(bold dots) shows the curve of the noise in the phase related image P2 show- 



ing a phase shift of 90°. By averaging the phase related images there is pro- 
duced the curve 36 (crosses), in which the noise of 2-fold grid frequency is 
eliminated. 

[0043] In another embodiment of the invention, the algorithm based on four basic 

images showing a phase shift of 90° is again used as starting point. In this 
embodiment, six basic images R<|, ...,R6 successively out-of-phase by 90° are 

recorded. The recording time is prolonged by 50% as against the standard al- 
gorithm. Then three phase related images are computed using the standard 
algorithm, a first phase related image P-| from the basic images R-| to R4, a 

second phase related image P2 from the basic images R2 to R5, and a third 

phase related image P3 from the basic images R3 to Rq. 

[0044] Since the individual basic images of the first and third phase related images 

R<|, R3 to R4, Rs show a phase shift of 180° relatively to each other, the two 
phase related images and P3 also exhibit a phase shift of 180° relatively to 
each other. By averaging the phase related images P^ and P3, noise of 1-fold 
grid frequency is suppressed to a high degree or eliminated. This is illustrated 
in the graph of Fig. 4, which depicts the amplitude A of noise of 1-fold grid fre- 
quency as a function of the phase cp. 

[0045] The line 42 (light squares) depicts the curve of the noise in the phase related 

image P<j, and the line 44 (bold dots) depicts the curve of the noise in the 
phase related image P3 showing a phase shift of 180°. By averaging the 
phase related images there is produced the curve 46 (crosses), in which the 
noise of grid frequency is eliminated. It is then possible to average the phase 
related image P2, as described above, with the intermediate phase related im- 
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age P2 obtained by averaging the phase related images P-| and P3, in order to 
eliminate noise of 2-fold grid frequency. 

[0046] The statements referring to the phase related images apply equally to contrast 

images. 

[0047] In a manner similar to that described in the above methods it is also possibly 

to eliminate noise of 4-fold grid frequency by averaging two phase related im- 
ages or two contrast images computed from basic images showing a phase 
shift of 45°. During this operation a specific property of field sensors can be 
utilized. In the case of a phase shift of the basic images of 90° the two fields 
will show a phase shift of 45°. This can be utilized by averaging the'two phase 
related images or contrast images for the elimination of noise of 4-fold grid 
frequency. The loss of resolution is, in the case of strong noise, more than 
compensated by the gain in measuring accuracy. 

[0048] Periodic disturbances can occur sporadically as a response to external influ- 

ences or may always be present due to the system used. For this reason, in a 
preferred embodiment, the occurrence of disturbances of 1-fold, 2-fold, or 4- 
fold grid frequency is determined by Fourier analysis of a relief image of a test 
object, for example, a plane. 

[0049] This can be carried out without additional time expenditure during calibration 

of the system, as is in any case necessary. Then, depending on which multi- 
ples of the grid frequency are found, a suitable computation scheme can be 
used which suppresses only those disturbances having the found frequencies 
and can thus be carried out in as short a time as possible. The drawbacks of 
the aforementioned corrections, i.e., longer recording time and/or loss of reso- 
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lution, do not occur unnecessarily. A longer exposure time is often particularly 
disadvantageous when the measuring system and the object to be imaged can 
be freely positioned relatively to each other. 

[0050] A device for carrying the described method into effect is shown in Fig. 5 in the 

form of an intraoral camera 1. 

[0051] The intraoral camera can be introduced at one end 2 into an oral cavity 3 of a 

patient 4 and the recorded image data of an object 20 can be read via a cable 
6. The evaluation unit 16 computes a relief image of the object to be imaged 
20 from several basic camera images that are out-of-phase with each other 
and are grouped so as to form at least two groups of basic images. The 
evaluation unit 16 can comprise components of a commercial PC. The camera 
1 exhibits a projection ray trajectory 13 for the production of a striped pattern 
on the object to be imaged 20. Via a trajectory of observation 15 the striped 
pattern projected on to the object to be imaged 20 is recorded as a basic im- 
age by a detector 17. 

[0052] The intraoral camera of Fig. 5 contains, for this purpose, projecting means 12 

illustrated in Fig. 6 for projecting a striped pattern on to the object to be im- 
aged, said pattern being produced by a grid 19 disposed in the projection ray 
trajectory 13. The grid 19 is moved by a flexure-mode resonator 23 in a direc- 
tion 24 substantially normal to the direction of projection. This usually takes 
place continuously, although the properties of the flexure-mode resonator 
must be taken into consideration. Since these movements are small, manufac- 
turing variations in the behavior of the flexure-mode resonator have an influ- 
ence on this movement that cannot be disregarded. Basically, it is also possi- 
ble to move the grid in jumps instead of continuously such that the striped pat- 
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tern stays still during the integration time, i.e. during the exposure time of the 
image detector. 

[0053] It is to be noted that R m refers to all the basic images of the camera held in the 

same position. One exposure is divided in "m" shots, whereby the phase an- 
gle between the two shots has been modified. In practice, one exposition lasts 
about 0.5 seconds and each of the shots last about 40 ms seconds. Out of 
the number of "m" shots, acquired during one exposition, with the camera held 
in one position, an image is calculated by using the images of several shots up 
to a number of "n" or "m+1." Thus, the number "m" is always greater than the 
number "n". Depending on the method used, "m" is equal to "n+1" or "n+2". 

[0054] And, the relief image may be a three-dimensional image while the contrast 

image may merely be a black-and-white image. The phase related image may 
correspond to the image of one shot. 
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